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Abstract 

We exhibit a 6-element semigroup that has no finite identity basis but 
nevertheless generates a variety whose finite membership problem admits 
a polynomial algorithm. 
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00 ■ 1 Motivation and overview 

O. 

Developments in the theory of computational complexity have shed new light 
on algorithmic aspects of algebra. It has turned out that many basic algo- 
rithmic questions whose decidability is well known and/or obvious give rise to 
^ ■ fascinating and sometimes very hard problems if one looks for the computa- 

tional complexity of corresponding algorithms^. A good example is provided 
by the problem Var-Memb studied in this paper: given two finite algebras A 
and B of the same similarity type, decide whether or not the algebra A belongs 
to the variety generated by the algebra B. Clearly, the problem Var-Memb 
is of importance for universal algebra in which equational classification of al- 
gebras is known to play a central role. At the same time, the problem is of 
interest in computer science and, in particular, in formal specification theory 
(cf. [TJ Section 1]) and in formal language theory (see discussion below). The 
fact that the problem Var-Memb is decidable easily follows from Tarski's HSP- 
theorem and has already been mentioned in Kalicki's pioneering paper [9]. The 
question about computational complexity of this problem has been explicitly 
posed much later, namely, in Kharlampovich and Sapir's well-known survey, 
see [101 Problem 2.5]. A systematic study of this question has then started and 



1 In this paper complexity is understood in the sense of the monographs [5)[26]; the reader 
can find there the definitions of the complexity classes P, NP, EXPSPACE, and 2-EXPTIME 
that are mentioned below. 
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brought interesting and rather unexpected results. Bergman and Slutzki [TJ 
extracted an upper bound from an analysis of Kalicki's proof: the problem 
Var-Memb belongs to the class 2-EXPTIME of problems solvable in double 
exponential time. For some time it appeared that this bound was very loose 
but then Szekely |32] showed that the problem is NP-hard, and Kozik [13|,ll4j 
proved that it is even EXPSPACE-hard. Finally, Kozik |15| has shown that the 
problem Var-Memb is 2-EXPTIME-complete, thus confirming that the bound 
by Bergman and Slutzki in general is tight. Thus, the problem Var-Memb has 
turned out to be one of the hardest algorithmic problems of universal algebra. 

The problem Var-Memb is of a special interest for semigroups in the view 
of the well-known Eilenberg correspondence |4J between varieties of regular lan- 
guage and pseudovarieties of semigroups^. By this correspondence, a regular 
language belongs to some language variety L if and only if the syntactic semi- 
group of the language belongs to the pseudovariety of semigroups corresponding 
to L. Therefore, estimating complexity of the semigroup version of Var-Memb, 
one can deduce conclusions about computational complexity of some important 
problems in formal language theory. At the present moment, the precise com- 
plexity of the problem Var-Memb for semigroups has not yet been determined 
but it is known that the problem is NP-hard (Jackson and McKenzie [6j). In 
what follows, we concentrate on the problem Var-Memb for semigroups. 

A reasonable strategy for analyzing Var-Memb in detail consists in fixing 
the semigroup B as a parameter so that the role of an input is played by the 
semigroup A only. This approach splits Var-Memb into a series of problems 
Var-Memb(-B) that are parameterized by finite semigroups and leads to the 
question of classifying finite semigroups with respect to computational com- 
plexity of the membership problem for the varieties these semigroups generate. 
Let us proceed with precise definitions. 

Let B be an arbitrary but fixed finite semigroup and let var B be the variety 
generated by B. The problem Var-Memb(S) is a combinatorial decision prob- 
lem whose instance is an arbitrary finite semigroup A, and the answer to the 
instance A is "YES" or "NO" depending on whether or not A belongs to the 
variety vaiB. If there exist a deterministic Turing machine and a polynomial 
p(x) with integer coefficients, both depending on the semigroup B only, such 
that for every finite semigroup A, the machine decides in time at most p(|^4|) 
whether or not A belongs to the variety var B, then we say that B is a semigroup 
with polynomially recognizable variety. Similarly, if there is no such polynomial, 
but there exists a real constant a > 1 such that for every finite semigroup A, 
the machine decides the same question in time at most a} A \ then we say that 
B is a semigroup with exponentially recognizable variety, etc. The classification 
question mentioned in the previous paragraph is essentially the question of an 
efficient characterization of finite semigroups with polynomially (exponentially 
etc.) recognizable varieties. We notice that Jackson and McKenzie [6] have 
exhibited a 56-element semigroup JM for which the problem Var-Memb(JM) 

2 Recall that a semigroup pseudovariety is a class of finite semigroups closed under tak- 
ing subsemigroups and homomorphic images and under forming finitary direct products. In 
particular, the class Vfl n of all finite semigroups in a given variety V is a pseudovariety. 
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is NP-hard. This means that under the standard assumption P ^ NP, the 
semigroup JM is not a semigroup with polynomially recognizable variety. 

Semigroup with polynomially recognizable varieties could be alternatively 
called semigroups with easily verifiable identities. Indeed, by the definition 
the variety var B consists of all semigroups satisfying every identity holding in 
B, whence testing membership of a given semigroup A in the variety var£> is 
nothing but testing whether A satisfies every identity of the semigroup B. This 
observation immediately implies a simple but important conclusion: 

Lemma 1. If all identities holding in a semigroup B follow from a finite set £ 
of such identities, then B generates a polynomially recognizable variety. 

Proof. Under the premise of the lemma, in order to check whether or not 
a given finite semigroup A belongs to the variety vari3, it suffices to check 
whether or not A satisfies all identities in S. To check that an identity u = v 
in £ holds in A, provided that u and v together depend on m variables, one 
can simply substitute for the variables all possible m-tuples of elements of A 
and then check whether or not all substitutions yield equal values to the words 
u and v. The number of m-tuples subject to the evaluation is \A\ m while time 
needed to calculating the values of the words u and v depends only on the 
length of these words and not on the size of the semigroup A. Hence the total 
time consumed by this algorithm is bounded by a polynomial of degree m in 
\A\. Since the number of identities in £ also does not depend on the size of 
A, we see that the inclusion A G varl? can be verified in polynomial in |^4| 
time. □ 

A semigroup that satisfies the premise of Lemma Q] is said to be finitely 
based. The question which finite semigroups are finitely based and which are 
not plays a central role in the theory of semigroup varieties for more than 
40 year, see [38J for a survey of the corresponding area. Lemma [T] links this 
question and the problem of characterizing finite semigroups with polynomially 
recognizable varieties. 

It is easy to see that in general a polynomially recognizable variety need not 
be finitely based. Here the variety B^B2 of all extensions of groups of exponent 4 
by groups of exponent 2 studied by Kleiman [11] can serve as a simple example. 
(Since this class consists of periodic groups, it also forms a semigroup variety.) 
Indeed, it is shown in [11] that the variety $4,62 is nonfinitely based. On the 
other hand, if A is a finite semigroup, then in order to test the membership 
of A in it suffices to test whether or not A is a group, and if this is the 

case, to check whether or not the normal subgroup generated by all squares in 
A has exponent 4. Clearly, both these checks can be performed in polynomial 
(in fact, cubic) in \A\ time. 

The situation changes essentially if one considers a variety generated by 
a finite semigroup. Here one cannot find a similar example among varieties 
consisting only of groups because by a classic result by Oates and Powell [24] 
every finite group is finitely based. In [10, Theorem 3.53] the authors describe a 
certain semigroup variety S and claim that S is polynomially recognizable and 
that one can deduce from Sapir's result [29] that S is nonfinitely based and is 
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generated by a finite semigroup. However, an algorithm for testing membership 
of a finite semigroup in the variety S is described in neither [10] nor subsequent 
publications; no finite semigroup generating S is explicitly exhibited. More- 
over, the reference to [29] does not appear to be fully legitimate because it is 
clear from the description of the variety S in Theorem 3.53] that all groups 
in S have exponent 4 while semigroup varieties analyzed in [29] contain only 
groups of odd exponent. We do not doubt the validity of the claim announced 
in [101 Theorem 3.53], but we believe nevertheless that in order to clarify the 
relationship between the properties of a finite semigroup "to be finitely based" 
and "to generate a polynomially recognizable variety" , it is worthwhile to pro- 
vide a more transparent example with complete justification. This is the goal 
of the present paper. 

We exhibit a 6-element semigroup AC2 that is nonfinitely based and at the 
same time generates a polynomially recognizable variety. We explicitly write 
down an infinite identity basis for AC2 and describe in detail a polynomial 
algorithm for testing membership of an arbitrary finite semigroup in the variety 
var AC2 ■ 

We notice that our example has the minimum possible number of elements 
because it is well known that every semigroup with five or fewer elements is 
finitely based (HUES]. Surprisingly, it seems that the semigroup AC2 has not 
yet appeared in the literature. The reader may be aware of the other 6-element 
nonfinitely based semigroup, the so-called Brandt monoid B\ formed by the 
following 2 x 2-matrices 

fo 0\ fl 0\ fl 0\ fO 1\ (0 o\ fo 0\ 

Vo oy' Vo v' Vo o)' \o o)' \i oy' Vo ly 

under usual matrix multiplication. Since the pioneering paper by Perkins |27j . 
the Brandt monoid appears over and over again in publications on the the- 
ory of semigroup varieties for more than 40 years. It is known that B\ has 
many remarkable properties (including those related to computational com- 
plexity, see [i"2"|l30]) but the question about the complexity of the problem Var- 
Memb(5|) still remains open (and is very intriguing in our opinion) . Therefore 
at the moment one cannot use the Brandt monoid as the example we are looking 
for. 

A further interesting property of the semigroup AC2 is that var AC2 is a 
limit variety, that is, a minimal (under class inclusion) nonfinitely based variety, 
see |18] , Thus, our example is minimal not only with respect to the number of 
elements but also with respect to the natural ordering of varieties. 

The paper is structured as follows. In Section 2 we construct the semi- 
group AC2, establish its identity basis, and give a structural characterization 
of semigroups in the variety vai AC2- In Section 3 we show how to use this 
characterization in order to check, given a finite semigroup S, whether or not 
S € vaiAC 2 in time 0(|S| 3 ). 

We assume the reader's acquaintance with rudiments of semigroup theory 
up to the first three chapters of the monograph [3] as well as with some basics 
of the theory of varieties, see [21 Chapter II]. For the reader's convenience we 
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recall here the notion of a Rees matrix semigroup which is important for the 
present paper. 

Let G be a group, be a symbol not in G. Further, let I, A be non-empty 
sets and P = (p\^) be a A x /-matrix over GU {0}. The Rees matrix semigroup 
M°[G;I, A;P) over the group G with the sandwich-matrix P is the semigroup 
on the set (I x G x A) U {0} under multiplication 



2 The semigroup AC2 and its identity basis 

Let A2 denote the 5-element idempotent-generated 0-simple semigroup. It can 
be defined in the class of semigroups with zero by the following presentation: 



The semigroup A2 can be also thought of as the semigroup formed by the 
following 2 x 2-matrices (over an arbitrary field) 



under the usual multiplication of matrices or as the Rees matrix semigroup over 
the trivial group E = {1} with the sandwich-matrix (J j). 

The semigroup AC2 is obtained by adding a new element c to the semi- 
group A2. The multiplication in AC2 extends the multiplication in A2 and the 
products involving the added element c are defined as follows: 



(In order to avoid any confusion, we stress that the element is no longer a 
zero in AC2 since 0c = cO = c.) The fact that the multiplication defined this 
way is associative can be straightforwardly verified but can be also obtained 
without calculations if one observes that the groupoid AC2 is isomorphic to a 
subsemigroup of the direct product of the semigroup A2 with the cyclic group 
C2 = (c I c 2 = 1) = {c, 1}, namely, to the subsemigroup consisting of all the 
pairs of the form (x, 1), where x € A2, and the pair (0,c). 

By the construction, A2 is a subsemigroup in AC% on the other hand, 
the elements and c form in AC2 a subgroup isomorphic to the group C%. 
(Thus, AC2 is obtained via amalgamating A2 and C2 such that the zero of the 
semigroup A2 is identified with the identity element of the group C2 ) Since 
A2,C2 £ var AC2, we have A2 x C2 £ v&rAC2- Conversely, as mentioned 
above, the semigroup AC2 embeds into the direct product A2 x C2 whence 
AC2 £ var(^2 x C2). We see that the semigroups AC2 and A2 x C2 generate 
the same variety, in other words, they satisfy the same identities. It follows 
from the results of |37| (cf. Remark 2 in the discussion of the main theorem 



x . = • x = for all x £ (7 x G x A) U {0}, 




A2 = (a,b I a 2 = aba = a, bob = b, b 2 



0) = {a, b, ab, 6a, 0}. 




and xc = cx = c for all x € A2 ■ 
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there) that for every group G of finite exponent the direct product A2 x G is 
nonfinitely based. Hence we obtain the first property of the semigroup AC2 we 
need. 

Lemma 2. The semigroup AC2 is nonfinitely based. 

Remark 1 . The short note [2D] contains an announcement (with a proof sketch) 
of the following fact: the Rees matrix semigroup over the group C2 with the 
sandwich-matrix ( J } ) is nonfinitely based. It is not hard to show that this 
9-element semigroup generates the same variety as the semigroups AC2 and 
A2 x C2. Therefore Lemma [JJ can also be deduced from the result of |20j. 

Now we describe the identities of the semigroup ACi- For a word w, we 
denote by alph(w) the set of variables that occur in w and by \w x \ the number 
of occurrences of the variable x in w. Given a word w, we assign to it a directed 
graph G(w) whose vertex set is alph(u>) and whose edges correspond to factors 
of length 2 in uu as follows: G(w) has a directed edge from x to y (x, y € alph(w)) 
if and only if some occurrence of x in uu immediately precedes some occurrence 
of y. We will distinguish two (not necessarily different) vertices in G(w): the 




Figure 1: The graph of the word w = x 2 yzxzy 2 zt 2 and the corresponding walk 

initial vertex, that is the first letter of uu, and the final vertex, that is the last 
letter of uu. Then the word w defines a walk through the graph G(w) that starts 
at the initial vertex, ends at the final vertex and traverses each edge of G(w) 
(some of the edges can be traversed more than once). 

Figure [1] shows the graph G(w) for the word w = x 2 yzxzy 2 zt 2 . The ingoing 
and the outgoing marks show respectively the initial and the final vertices of the 
graph. In Fig.[T]each edge of the graph is labelled by the numberfs] correspond- 
ing to the occurrence [s] of the edge in the walk induced by the word uu. We 
stress that, in contrast to the vertex names and the ingoing/outgoing marks, 
these labels are not considered as a part of the data making the graph G(uu). 
Therefore the graph does not determine the word w: for instance, as the reader 
can easily check, the word xy^zyzx 2 zyzt 3 has exactly the same graph (but 
corresponds to a different walk through it, see Fig.[2j). 

Observe that in terms of the graph G(w), the number \w x \ represents the 
number of times that the walk induced by the word w visits the vertex x. 
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Proposition 3. An identity u = v holds true in the semigroup AC2 if and only 
if the graphs G(u) and G(v) coincide and, for each variable x, the numbers \u x \ 
and \v x \ have the same parity. 

Proof. We have mentioned above that the semigroups AC2 and A2 x C2 satisfy 
the same identities. Clearly, an identity holds in the semigroup A2 x C2 if and 
only if it holds in each of the semigroups A2 and C2 ■ It is known that an identity 
u = v holds true in the semigroup A2 if and only if the graphs G{u) and G(v) 
coincide, see [33J1. Further, it is known (and easy to verify) that an identity 
u = v holds true in the group C2 if and only if the numbers \u x \ and \v x \ have 
the same parity for each variable x. □ 

Proposition [3] immediately implies 
Corollary 4. The identities 

x 2 = x\ (1) 
xyx = (xy) 3 x, (2) 
xyxzx = xzxyx, (3) 

/ 2 2 2\2 _ / 2 2 2^3 — O Q I A\ 

\ x \ x 2 ' ' ' x n) ~ \ x l x 2 ' ' ' x n) ) n — Z, O, . . . , (^4J 

hold true in the semigroup AC2- 

Proof. It is easy to see that for each of the identities ([I])-©, the graph of its 
left hand side coincides with the graph of its right hand side (the graphs are 
shown in Fig. [3]) and each variable occurs on the left and on the right with the 
same parity. □ 

We aim to clarify the structural meaning of the identities (JTJ) — - We start 
with the series ©. Recall that a semigroup is said to be combinatorial if all of 
its subgroups are singletons. 



3 In the literature (see, for instance, [16] or [36]) one sometimes refers to [19] as the source for 
this result even though the paper [19] does not deal with the semigroup A2 at all. Apparently, 
this mistake originates from an erroneous reference in the survey paper [31] . 
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(4) 

Figure 3: The graphs of the identities (JT|) — 

Proposition 5. If a semigroup S satisfies the identities ©, then the subsemi- 
group generated by all idempotents of S is combinatorial. If S satisfies the 
identity ([1]), then the converse is true as well. 

Proof. Since every idempotent can be represented as a square, products of 
the form x\ ■ ■ ■ x^, n = 2, 3, . . . , represent all elements of the subsemigroup T 
generated by all idempotents of S. If 5 satisfies ©, then T satisfies the identity 

x 2 = x 3 (5) 

that cannot hold in a non-singleton group. Hence, the subsemigroup T is com- 
binatorial. 

Conversely, let S satisfies the identity ©. Then the subsemigroup T also 
satisfies this identity but in a combinatorial semigroup ([1]) implies ([5]). In the 
presence of the identity ©, the square of each element of S is an idempotent 
whence the values of all products of the form x\ ■ ■ ■ x\, n = 2, 3, . . . , lie in T. 
Substituting these products for the variable in ([5]), we see that S satisfies all 
identities from the series dH). □ 

The variety generated by all completely 0-simple semigroups whose sub- 
groups have exponent n is commonly denoted by HS n - Clearly, the semigroup 
AC2 belongs to the variety US 2- The next results reveals the role of the iden- 
tities CO)-©: 

Proposition 6. The identities ([I])-© form an identity basis of the variety 
KS 2 . 

We do not prove Proposition [6] here because it is not used in the present 
paper. We notice that various identity bases for lZS n have been provided in 
l2"T |l23fi Unfortunately, the proofs of the corresponding results in these papers 
cannot be considered as complete because they all essentially use a lemma 
from [21] whose proof in |21] is wrong. We shall discuss these nuances in the 

4 However, the identity basis for 7?<S2 specified in Proposition [6] is not a specialization of 
the bases for 7ZS„ provided in [TI I211I25] . 
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course of the proof of the next theorem that plays a key role in the present 
paper. 

Theorem 1. The identities (|T|) — 01) form an identity basis for ACi- 

The proof follows a scheme suggested in [T7]. We need a few auxiliary 
statements. 

A word w of length at least 2 is said to be connected if its graph G(w) is 
strongly connected^. Let V be the variety defined by the identities (pQ)-(jl]). 

Lemma 7. If w is a connected word and S is a semigroup in V , then every 
value of w in S is a regular element in S. 

Proof. We recall that an element s £ S is said to be regular in S if there exists 
an element s' € S such that ss's = s. Therefore in order to prove the lemma 
it suffices to construct a word w' such that the variety V satisfies the identity 
w = ww'w. If the word w begins and ends with the same variable, then we 
can apply the identity ([2]) to it (or the identity (pQ) in the case when w is the 
square of a variable) and we immediately get the necessary conclusion. We may 
therefore assume that w begins with a variable x and ends with a variable y 
such that x ^ y. 

Since the word w is connected, each of the variables x and y occurs in w 
more than once. We want to show that, applying the identities ([2]) and (|3|), 
one can transform w into a word in which some occurrence of the variable x 
appears after some occurrence of the variable y. For this, it is convenient to 
prove a slightly more general lemma. 

Lemma 8. Let w be a connected word, x, y € alph(u>) and 

w = Wixw2yw3, x $l alph(w2?/W3) and y alph(u>ixw2)- (6) 

Applying the identities ([2]) and ([3]) ; one can transform w into a word Wixw^yw^ 
such that x, y 6 alph(w' 2 ) and some occurrence of the variable x in w' 2 appears 
after some occurrence of the variable y in w' 2 

Proof. First of all, we observe that if some occurrences of the variables x 
and y happen between two occurrences of some variable z, then the desired 

5 This concept sometimes appears in the literature under different names. For instance, 
in [21] a word w of length at least 2 is said to be covered by cycles each if each of its factors of 
length 2 occurs in a factor of wthat begins and ends with a common letter. In the language 
of the graph G(w), this means that each directed edge x —¥ y of G(w) belongs to a directed 
cycle (namely, to the walk induced by a factor of w that starts and ends with the same 
letter and contains xy). It is one of the basic facts of the theory of directed graphs (cf. |25] . 
Theorem 8.1.5) that such a graph is strongly connected if and only if each of its directed edges 
belongs to a directed cycle. Thus, words covered by cycles in the sense of [21] are precisely 
connected words in our sense. Yet another name for an obviously equivalent concept has been 
introduced in [28| . where a word w of length at least 2 is said to be prime if it cannot be 
decomposed as w = w'w" with alph(w') n alph(w") = 0. 
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transformation can be achieved by an application of the identity ([2]) to the 
factor bordered by these two occurrences of z: 



w = wiizwu xw 2 y W31ZW32 = wn(zwi2XW2yw 3 i) 3 zw 32 (by ©) 

V v ' V v ' 

= wi 1 zw\2 xw-jywzi zw\2 XW2 ywzi ZW12XW2 y w^i zw^ 2 ■ 

Wl 103 

(The "permuted" occurrences of the variables x and y are underlined twice.) 

Now we induct on the length of the word W2 in the decomposition (|6|), that 
is, on the distance between the right most occurrence of x and the left most 
occurrence of y. If this distance is equal to 0, then the word w has xy as a factor. 
Since w is connected, this factor should appear between two occurrences of some 
variable z, and then the argument from the previous paragraph applies. This 
proves the induction basis. 

Now suppose that in the decomposition @ the word W2 is not empty. 
In view of the first paragraph of the proof, we can assume that aXph(wxx) (~l 
alph(yw3) = 0. Since w is connected, the word W2 must have common variables 
with each of the words w\ and w 3 . Consider two cases. 

Case 1. Some variable z E alph(tui) n alph(w2) occurs in the word W2 to the 
left of some variable t £ alph(u>2) n alph(u;3). 

In this case, the desired transformations are as follows: 

W = Wn ZW12 X W21 tW22,ZW2Z y ^31^32 
Wl W2 W3 

= wn(zw 1 2XW2itw22z) 3 W23yw 31 tw 3 2 (by ©) 

= WiiZWi2XW2ltW22ZWi2XW2ltW22ZWi2XW2ltW22ZW2 3 yW 3 itw 3 2 

= WnZWi2XW2ltW22ZWi2XW2ltW22ZWi2XW2l(tW22ZW23yW 3 i) 3 tw 3 2 (by ©) 

= WnZWi2XW2ltW22ZWi2XW2l tW22ZWl2XW2ltW22ZW2 3 yW 3 it X 

X W22ZW2 3 yW 3 itW22ZW 23 yW 3 itw 3 2 
= WnZWi2 XW2ltW22ZWi2XW2ltW22ZW2 3 yW 3 ltW22ZWi2gW2lt X 
wi 

x W22zw 23 yw 31 tw22zw 23 y w 3 itw 3 2 y (by Q). 

(The factor to which the identity ([3]) has been applied is underlined once while 
the "permuted" occurrences of the variables x and y are underlined twice.) 

Case 2. Every variable from alph(wi) H alph(w2) occurs in the word W2 to the 
right of every variable from alph(u;2) D alph(w3). 

We take some variables z G alph(ii; 1 )nalph(w2) and t G alph(ti;2)nalph(w3). 
Since both z and t occur in the word W2 while both x and y do not, the distance 
between the right most occurrence of the variable z and the left most occurrence 
of the variable t is less than distance between the right most occurrence of the 
variable x and the left most occurrence of the variable y. Thus, we can apply 
the induction assumption to the word w and the variables z,t. This means that 
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if we write the word w as 



w = v±zv2tV3, z £ alph(u2if3) and t £ alph^iz^), 

then applying the identities ([2]) and ([3]), we can transform w into a word v = 
Vizv' 2 tv3 such that z,t € alph^) and some occurrence of the variable z in v' 2 
appears after some occurrence of the variable t in v' 2 - However the word v and 
the initial variables x, y then satisfy the condition of Case 1 that is considered 
above. □ 

Now we return to the proof of Lemma[7J Recall that we consider a connected 
word w that begins with a variable x and ends with a variable y such that x ^ y. 
By Lemma[8]we may assume that some occurrence of the variable x'm.w appears 
after some occurrence of the variable y in w. Hence 

w = xw\yw2xwzy = (xwiyw2) 3 xwsy (by (|2|)) 
= xw%yw2XW\yw2XW\yw2XWzy 

= xwiyw2XWiyw2XWi(yw2XWs) 3 y (by ([21)) 
= xw\yw2XWiyw2XWiyw2Xw^yw2Xw^yw2XW2,y 

= xw\yw2xwiyw2xw^yw2xwiyw2xwzyw2xw^y (by Q) 

= xw\yw2xw^yw2xw^yw2xw\yw2xw^yw2xw^y (by ©) 

= xw\yw2xw%y W2XWiyw2XWzyw2 xw\yw2XW3y (by ([3])). 



(The factors to which the identity ([3]) has been applied are underlined.) Thus, 
we have deduced an identity of the form w = ww'w from ([I])-©, as required. 

□ 



Remark 2. Lemma[7|is a partial case of a similar result claimed by Mashevitsky 
in |2R Lemma 6], see also \22\ Lemma 7]. As we have already mentioned, 
this result has been used (with reference to [21] ) in several important papers, 
in particular, [7] and |23| . However, its proof in |21| contains a fatal flaw 
and so does the English translation of the proof published in [22]. Namely, 
in [21] Lemma 6 is deduced from Lemma 5 which claims that every word u 
covered by cycles can be transformed modulo certain identities into a word of 
the form z\u\Z\ ■ ■ ■ z^u^z^ where z±, . . . , z^ are variables and Zi+i £ alph(nj) for 
all i = 1, . . . , k — 1 provided that k > 1. In order to justify the latter claim, 
Mashevitsky inducts on | alph(n) | but in the course of the proof he illegitimately 
applies the induction assumption to a factor that in general is not covered by 
its cycles. The word xyxzy can be used as a concrete counter example showing 
that the argument from |21| does not work: here the induction assumption 
should have been applied to the factor zy which is certainly not covered by its 
cycles. 

We observe that our proof of Lemma [7] invokes only the identities (P)-©. 
Some modification of our argument applies also to the identities considered 
in [21] and allows one to prove Lemma 6 of |21j . Thus, results of [7] and |23] 
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that rely on the lemma are correct. Moreover, the third author of the present 
paper has recently proved that already the identities ([I]) and ([2]) suffice to ensure 
that the value of every connected word is regular; an analogous generalization 
also holds in the situation considered in [21 J. 

A semigroup S is called E-separable if for every pair p, q of distinct elements 
in S, there exist idempotents e, f £ S such that pe ^ qe and fp ^ fq. 

Lemma 9. The semigroup AC 2 is E-separable. 

Proof. This amounts to filling out the following table where for each pair p, q 
of distinct elements in the semigroup AC 2 , we exhibit some idempotents e and 
/ that separate p and q respectively on the right and on the left. □ 



V 


c 





a 


a 


a 


ab 


ab 


ba 


Q 


x e A 2 


y e M \ {0} 


b 


ab 


ba 


b 


ba 


b 


e 





a 


a 


ba 


a 


a 


a 


ba 


pe 


c 





a 


a 


a 


a 


a 


ba 


qe 





a or ba 


ba 





ba 


ba 


ba 





f 





a 


a 


a 


ab 


ab 


a 


ba 


fp 


c 





a 


a 


a 


ab 


ab 


ba 


fq 





a or ab 


ab 


ab 








a 


b 



The next result that we need is the union of the first part of Proposition 3.2 
in [T7] with the dual statement. By Aq we denote the subsemigroup A 2 \ {a} = 
{b, ab, ba, 0} of the semigroup A 2 . 

Lemma 10. Let S be an E-separable semigroup and Aq £ varS*. Suppose that 
S satisfies an identity u = v such that the word u can be represented as u\u 2 
with alph(ui) (~lalph(u2) = 0. Then the word v can be represented as v%V2 such 
that alph(wi) = alph(«i), alph(w2) = alph(u2) and the semigroup S satisfies the 
identities u\ = v\ and u 2 = v 2 - 

The next lemma is borrowed from [7], see Lemma 3.2 there. 

Lemma 11. If for some n > 1 a semigroup S satisfies the identities 

x 2 = x n+2 , xyx = (xy) n+1 x, xyx(zx) n = x(zx) n yx, (7) 

then for every pair of distinct regular elements p,q G S there exist a completely 
0-simple semigroup K and a surjective homomorphism x '■ S — >• K such that 
PX ± QX- 

The last ingredient of our proof is a well-known result by Houghton [8j 
Theorem 5.1] formulated in a convenient for us way. 

Lemma 12. If the idempotents of a completely 0-simple semigroup S gener- 
ate a combinatorial subsemigroup, then S can be presented as the Rees matrix 
semigroup M° '(G) I , A; P) over a group G such that every entry of the sand- 
wich-matrix P is equal to either zero or the identity element of G. 
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Proof of Theorem [TJ Recall that we have denoted by V the variety defined 
by the identities (H])-©. By Corollary U] we have the inclusion var AC2 Q V. 
Arguing by contradiction, assume that this inclusion is strict. Then there exists 
an identity that holds in the semigroup AC2 but fails in the variety V. Among all 
such identities, we chose an identity u = v with the minimum possible number 
of variables in the word u. We aim to show that the words u and v must be 
connected. 

Assume for the moment that, say, u is not connected. This means that it 
can be decomposed as u = u\U2 with alph(i(i)nalph(-U2) = 0- By Lemma[9]the 
semigroup AC2 is -E-separable, and since AC2 obviously contains the semigroup 
Aq as a subsemigroup, we see that Lemma [TOl applies to AC2- By this lemma 
we have v = V1V2 where alph(fi) = alph(ui), alph^) = alph(u2) and both 
U\ = v\ and 112 = V2 hold in the semigroup AC2- Since | alph(m)|, | alph(it2)| < 
| alph(u)|, the choice of the identity u = v ensures that the identities u\ = v\ 
and U2 = V2 hold in the variety V. Clearly, the identity u = v is a consequence of 
these two identities whence it also must hold in V, a contradiction. Analogously, 
one checks that the word v must be connected. 

Now let S be a semigroup in V such that the words u and v take distinct 
values p and q under some interpretation of variables. By Lemma [7] these 
values are regular elements. If we compare the identities that define the variety 
V with the three identities (J7|) from the premise of Lemma [XT], we see that 
for n = 2 the first two of the three identities coincide with the identities (pQ) 
and ([2]) respectively while the third one readily follows from the identity ([3]). 
Thus, Lemma [11] applies to the semigroup S and its regular elements p and 
q. Therefore there exist a completely 0-simple semigroup K and a surjective 
homomorphism x '■ & — > K such that p\ 7^ QX- Observe that the elements 
PX and qx are also values of the words u and v under some interpretation of 
variables whence the identity u = v fails in the semigroup K. On the other 
hand, the semigroup K belongs to the variety V because it is a homomorphic 
image of the semigroup S € V. This means that we can use K instead of S; in 
other words, we may (and will) assume that the semigroup S from the "gap" 
between the varieties var AC2 and V is completely 0-simple. 

By Proposition [5] the idempotents of S generate a combinatorial subsemi- 
group, but then Lemma [12] implies that S can be presented as the Rees matrix 
semigroup M°(G; /, A; P) over a group G such that every entry of the sandwich- 
matrix P is equal to either zero or the identity element of G. Let T be the Rees 
matrix semigroup M°(E; I, A; P) over the trivial group E = {1} with the same 
sandwich-matrix P. It is known (see, e.g., [17, Proposition 1.2]) that every 
completely 0-simple semigroup over the trivial group belongs to the variety 
generated by the semigroup A2] in particular, T € var A^. Further, the group 
G is isomorphic to a maximal subgroup in S whence G G V. Therefore G 
satisfies the identity (pQ) and hence G is a group of exponent 2. It is well-known 
that every group of exponent 2 belongs to the variety generated by the group 
C2; in particular, G E varC2- 

It is easy to verify that the mapping T x G — > S that sends the pair 
((i, 1, A), g) € T x G to the element (i, g, A) G S is a surjective homomorphism. 
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Since T £ var A 2 and G 6 var C2 , we have 

T x G G var(A 2 X C 2 ) = var AC 2 , 

whence S 1 E var AC 2- This contradicts the choice of the semigroup S. The 
theorem is proved. □ 

3 A polynomial algorithm for Var-Memb(AC2) 

Given a semigroup S with \S\ = n, we want to test whether or not S belongs 
to the variety var AC 2 - For this, by Theorem [IJ it is necessary and sufficient 
to test whether or not S satisfies the identities CO)-©. Testing the identities 
([I])-© requires 0(n 3 ) time, see the argument in the proof of Lemma [TJ No 
straightforward test for the infinite identity series dU) is possible but here we can 
use the structural equivalent from Proposition it is necessary and sufficient 
to test whether or not the subsemigroup of the semigroup S generated by all 
idempotents of S is combinatorial. We will show that this can also be tested in 
0(n 3 ) time. 

Calculating squares of all elements of the semigroup S, we can find the set 
of all idempotents in S in 0(n) time. Let T\ be this set and define inductively 
Ti + \ = T(T\. It is clear that constructing each set Tj+i requires at most n 2 steps. 
Further, it is easy to see that Tj C Tj+i and that if Tk = Tk+\ for some k, then 
Tk = for all I whence is a subsemigroup in S. By the construction, every 
element in Tk is a product of idempotents, and therefore, coincides with the 
subsemigroup of the semigroup S generated by all idempotents of S. Since no 
strictly increasing chain of subsets of S can contain more than n subsets, we 
have k < n, and the subsemigroup will be constructed this way in 0(n 3 ) 
time. Now it remains to test whether or not Tk is combinatorial and for this it 
is necessary and sufficient to test whether or not T/% satisfies the identity ©, 
see the proof of Proposition [5j This last check can be done in 0(n) time. 

Thus, we have proved the main result of the present paper: 

Theorem 2. The 6-element semigroup AC 2 has no finite identity basis but, 
given a finite semigroup S, one can test the membership of S in the variety 
\aiAC 2 in 0(|5| 3 ) time. 
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